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THE PREDICTION OF COLLEGE GRADES FROM THE 
CALIFORNIA PSYCHOLOGICAL INVENTORY AND 
THE SCHOLASTIC APTITUDE TEST" 


JOHN L 


Nat Ve 


This study is designed to explore the use- 
fulness of nonintellectual factors in predict- 
ing college grades and to provide needed 
information for the development of a theory 
Since an earlier 


SAT and high 


for 


of intellectual achievement 
that the 


I low 


niy 


indicates 
rank ha 
predicting the gra 


report 
efficiency 


] f 


17s Ol 


school \ 
a high aptitude 
sample within of talent 
(Holland, 1958), the present study was per- 


formed to test the usefulness of the CPI 


a narrow rang 


and SAT, separately and in combination, 
as predictors of scholastic achievement for 
a sample of exceptionally talented college 
freshmen attending 291 colleges and uni- 
versities. The results of this study provide 
a test of the predictive validities of these 
instruments, since the student sample was 


tested prior to college entrance 


STUDENT SAMPLE 

The student sample was obtained from 
an earlier study (Holland, in press) in which 
National Merit finalists were tested with 
the CPI a month before the fall term of 
1957. The SAT had been administered to 
this student sample about seven months be- 


1 This study was partially supported by 
research grants from the National Science 
Foundation and the Old Dominion Founda 
tion. The author wishes to acknowledge the 
contributions of Donald L. Thistlethwaite 
and Laura Kent for their critical reviews of 
this paper 


H 


f Scholarship Corp yration, Evans 
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ton, Illinois 
fore the fall term. The sample included 743 
Merit Scholars and 578 Certificate of Merit 
winners drawn from a sample of 7500 final- 
ists, the survivors of a nationwide compe- 
tition in which 166,000 high school seniors 
National Merit Scholarship 


secause 


participated 
Corporation, 1957 
all psychometric and demographic similar- 
ity, Merit Scholars and Certificate of Merit 


of their over- 


winners were combined, and the total sam- 

ple was sorted randomly into two approxi- 

Boys 
in 


girls 


and 
both 


mately equal subgroups 


were analyzed separately sub- 
groups. The first subgroup (standard sam- 
ple) was used to develop regression equa- 
tions for each sex, and the second subgroup 
(cross-validation sample) was used for 
cross-validation. The Ns, means, and stand- 
ard deviations for each sample on the CPI, 
SAT, and HPR variables are shown in Ta- 
ble 1 

Table 1 indicates that the standard and 
cross-validation samples for both sexes are 
comparable with respect to CPI, SAT, and 
HPR measures. Table 1 also shows the high 
aptitude levels of these students and the 
The 
male samples average 670 and 710 on the 
Verbal and Mathematical sections of the 


SAT. The female samples average 682 and 


accompanying restriction in range 


654 on these same variables. The corre- 
sponding standard deviations for these vari- 


ables range from three fourths to less than 





JOHN L 


HOLLAND 


TABLE 1 


3-VALIDATION 
PSYCHOLOGICAI 


STANDARD AND CROs 


Test, CALIFORNIA 


andard 
= 476 


SAT-Verbal (SAT-\ 
SAT-Math (SAT-M 
Dominance (Do 
Capacity for Status 
Sociability (Sy 
Social Presence Sp 
Self acceptance ea 
Sense of Well being Wb) 
Responsibility (Re 
Socialization (So 
Self-control (Se 
Toler ince lo 
Good Impression (Gi 
Communality (Cm 
Achievement via 
Conformance 
Achievement via 
Independence Ai 
Intellectual Efficiency (le) 
Psychol gical 
mindedness (Py) 
Flexibility (Ix 
Femininity (Fe 
Honor Point Ratio 


HPR) 


standard deviation obtain 


SAT? 


one half of the 


in the standardization of the 


CRITERION 


Freshman grades in college, or honor 


point ratio, were used as the 
The grading s\ 
tems of all the study 


converted to HPR by means of the 


achievement 


scholastic 
were 


colleges in the 


stand 


ard formula* used by the majority of insti- 


this formula 


plied to collegiate grading systems by using 


tutions. Generally, was ap 


2? The SAT is standardized with a mean of 
500 and a standard deviation of 100 

* All grades were converted by an honor 
ratio formula where A = 4, B 3 
C = 2,D = 1, F = 0; grades were multiplied 


point 


by credits per course and divided by total 
credits carried 


SAMPLES IN 
INVENTORY, AND 


criterion of 


APTITUDE 
LATIO 


TERMS OF SCHOLASTIC 
Honor Pornt 


Girl 


Cross-validation 


(N = 179 
SD 


10 


riven in 

letters from the 
to be 
basis of 


Ss numericai 
letter grades 
gator’s best judgment 
RESULTS 
( intercorrelated with 
nd SAT variables for 
classified in three dif- 


grades wer 


y 
2 


student 
samples which wet 
ferent First, 
d for both the 


cross-validation samples, and multiple re- 


ways zero-order correlations 


were comput standard and 


gression equations derived from the stand- 


ard samples were applied to the cross-vali 


dation samples. Second, both the standard 


and cross-validation samples were dichot- 


omized as science or nonsciencé majors, 


and correlations were computed for thes 
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rABLE 2 
THE CORRELATION oF Grapes (HPR) wits THe ScHoLastic Aptitupe Test AND THI 
CALIFORNIA PSYCHOLOGICAL INVENTORY AcROoss 291 COLLEGES 


SAT-Verbal 
SAT-Math 
Dominance 
Capacity tor Stat 
Sociability 
Social Presence 
Self iccept ince 
Sense of Well-beir £ 
Re sponsibilit 
Socialization 
Self-Control 
Tolerance 
Good Impression 
Communality 
Achievement v 
Conformance 
Achievement via 
Independence 
Intellectual [-fhicienc 
Psychological-mindedness 
Flexibilit 


Femininity 


between Gough (1957, pp 3). Multiple correla 
mputed tions gression equations were ob 
more of tained by owing the DuBois (1957) pro 
nrolled cedure 
10WN in In f e resulting equation 
for boys is j ; 19Sp 4 
17Fe. The multi rrelati for th 
ind Ss \ | standard mal imple } whi is 
o test the efficiency of prediction, multipl nifi 


sig 
ition 


regression equations were derived from thi ilidation 
standard male and femal imp ind ap- esul n ) | ol eA 


lied to the corresponding cert va P 
I 


samples. To reduce computational The « 


sample of test var i vas selected tor 1 1485p 4 OO Rs 4 OR Fy 


clusion in the regi n equations multiple correlation he standard 
standard samples, w male sample is 2 is Significant 


Vi ible having the highest significar yond the .01 ication ol 


relation from tl ind fro ch equation t | oss-validation 


the four classes of scal sted b ampli 
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Ol 
although the cross-validation R is about 
one-half the standard R. 

The zero-order correlations in 


which is significant beyond the level, 


Table 2 
are also of interest. The mathematics fac 
tor of the SAT is statistically significant for 
17 and .15), but 
for only one of the female samples. The 


verbal factor is significant only for the male 


both male samples (r = 


and female standard samples 

For boys, the Capacity for Status (Cs 
Sociability (Sv), Social Presence (Sp), Self 
Responsibility (Re 
Self-control 


and Femininity 


So- 
Flexi- 


scales of 


acceptance (Sa 


(4 


(Fe 


(S90), 


cialization 
bility (Fx), 


the CPI are statistically significant for botl 


HOLLAND 


the standard and cross-validation samples 


The Socialization scale has the highest pair 
99 


22 and .29, for these sam- 
the Social 


Sp), and Socialization (So) scales are 


of correlations, 


ples. For girls, only Presence 
Sig- 
nificant in both samples. The small size of 
the 


limited number of significant correlations 


female samples may account for the 


on both instruments 
Table 


fying students in 


3 summarizes the results of classi- 
the four standard and 
cross-validation samples as science or non- 
science majors and recomputing the corre- 
lations between grades and test variables 
This classification was used to determine 


what effect a more homogeneous grouping 


TABLE 3 


GRADES WITH 
INVENTORY 


Tue CORRELATION OF THE 


PSYCHOLOGICAL 


Boys 


Standard 


SAT-Verbal 
SAT-Math 
Dominance 
Capacity for Status 
Sociability 
Social Presence 
Self-acceptance 
Sense of Well being 
Responsibility 
Socialization 
Self-control 
Tolerance 
Good Impression 
Communality 
Achievement via 
Conformance 
Achievement via 
Independence 
Intellectual Efficiency 
Psychological-mindedness 
Flexibility 
Femininity 


16 


15 \- 
14 
13 i- 


39** 


Note 
of major field is unkown or ambiguous 

* Significant beyond .05,level 

** Significant beyond .01 level 


ScHOLASTI 
FOR SCIENCE 


AND CALIFORNIA 
SAMPLES 


AptitupEe Test 
AND NONSCIENCE 


Girls 


Standard 


Non 


79 


13 
16 
23* 
19 
12 
06 
10 
33° 16 


03 11 26* 
04 
01 
03 
.20 


10 
05 
24° 


10 


OY 
13* |- 
13* |— 


21** 


09 
03 
16 |- 
.09 


14 
17 
09 
16 


The Ns for the standard and prediction samples have been reduced by eliminating students whose choice 
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THe CORRELATION OF GRADES 
PSYCHOLOGICAI 


TABLE 4 


HPR) wits Scuouastic Aptirupe Test anp CALIFORNIA 
INVENTORY VARIABLES WITHIN COLLEGES 


SAT-V 

SAT-M 

Dominance 

Capacity for Status 

Sociability 

Social Presence 

elf 

Sense of Well-be ing 

Responsibility 

Socialization 

Self-control 

Tolerance 

Good Impression 

Communality 

Achievement via 
Conformance 

Achievement via 
Independence 

Intellectual Efficiency 

Psychological -mindedness 

Flexibility 

Femininity 


ic ept ince 


Note.—C.L.1 


respectively 


and M.I.T. stand f 


* Significant beyond .05 leve 
** Significant beyond .01 kk 
have on the correlations 


would between 


grades and test variables and to discover 
if academic achievement in science 
a different set of aptitudes and pe 


variables than 


requires 
rsonality 
achievement in nonscience 


Since the average of the absolute values 


80 correlations in Table 3 is .13, 


which closely approximates the average r 
of .12 for Table 2, it is 


sification produced n 


lear that this clas- 


» change in the level 
of relationships between grades and test 
Table 


the freshman year, 


3 also suggests that, for 


18 of the 


variables 


20 variables 


predict grades for science and nonscience 


majors with about equal efficiency 
the Mathematics factor for boys and the Ac 
that these 


variables are significantly correlated with 


Only 


scale for girls are unique, in 


grades for both standard and cross-valida- 


Boys 


»4 ? 

49** (4 x”) 
OO 10 07 
54°* 51** 4)* 


logy and Massachusetts Institut 


tion samples, but neither is significantly re- 
lated to grades for the four nonscience sam 
ples 

SAT and CPI 
ables within individual colleges is shown in 


Table 4 
evaluate the effect of 


The correlation of vari 


This analysis was performed to 
a more reliable cTl- 


col- 


terion (the grading system of a single 


lege rather than the equating of multiple 
systems and to estimate the range of pre- 
dictive test 
from college SO correlations 


lable 4 
the SO « orrelations 


validities for single variables 
to college. The 
for the eight colleges included in 
average .21. In contrast, 
lable 2 average 
this difference 


differences in grading systems as well as in 


across colleges shown in 

12. Presumably is due to 

the aptitude level of student populations 
The general pattern of correlations in Ta- 
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that found for the total 
sample; that is, high grades are negatively 
associated with the Cs, Sy, Sp, Sa, and Fx 
scales and positively associated with the 


Wb, Re, So, Se, Gi, Ac, Ai, Py, and Fe 


In scale terms, these findings suggest 


ble 4 resembles 


P| ale = 
that the high 


is unsociable, lacks poise and self 


achiever lacks capacity tor 
status, 
confidence, is self-deprecating and inflexi 
ble, minimizes worries and complaints, is 
conscientious and responsible, is well con- 
trolled, and creates a favorable impression, 
does well ac ademically unde r direction but 
is not as adept in situations demanding inde- 
pendent judgment, is interested in and re 
ind has 
contrast. the low 


it hic ver is poised and Sor ially skillful h LS 


to the feelings of others, 


Sponsive 


feminine interests. In 


positive self-attitudes, is flexible, admits 


worries and complaints, has less intens 


superego qualiti Ss, 18 Impulsive, creates a 


1 1 
; Sses [ess mo 


] 
1eSs avorable Impression, Posse 


tivation lor ( demi i levement, and 


more « and masculine interests 


Although 
general pattern, the 


traceptuy 


individual follow this 


colleges 
eight colleges show a 


wide range of differences on a more limited 


number of scales. These findings sugges 
that 
leges ré sults 


achievement in the majority 


ror uu general cl st 


sonality and aptit ide variables, but 
iddition, a 


may demand 


specifi char ter ics 


note that the cor 


] 
elations 


between ‘.- and grades range from 
09 to 49: 
SAT-M rang: 


the relative pre dictive 


similarly, the correlations for 


from .07 to .49. In addition, 
value of V and M 


vary markedly within a given college. The 


Dominance scale ranges from .30 to 33; 
the Capacity for Status scale ranges from 
19 to 30; the Presence 
ranges from .OL to 47; the 


29 to 


Social 


Self 


ance scale ranges from 


Good Impression scal 
41: the 


ranges irom 


ranges from 
Achievement via 
14 to .43; 


logical-mindedness scale 


Independence 
the Psve ho- 


from .43 


scale 
ranges 
to —.49; and the Femininity scale ranges 


from .54 to 39 


HOLLAND 


The patterning of predictors within and 
to the 


environments 


between colleges may also be du 
variation in institutional 


rhistlethwaite (in press) found college 
press to be related to student achievement 
Consequently, the interaction of student 
motivational and personality characteris- 
tics and college presses may in part produce 
the correlational differences among colleges 
Table 4 
pears plausible since the majority of stand- 
deviations for the 
lable 4 are 
deviations for the total samples shown in 
lable 2. Accordingly, the 
size of the Table 4 

to the Table 2 correl 


to the intera 


shown in rhis interpretation ap- 


ard individual colleges 
listed in smaller than standard 
greater average 
correlations compared 
itions is probably due 


! 


tion of students and college 


is well as the use of 
relia ther than to differences 


student homogeneity mn the test 


environments 
hl 


i more 
criterion rf 


vari- 


results suggest that 


together, the 


me mda 


idual colleges, specific for- 
bstantially effec- 
ing grades could be devel- 


especially 


issumption appears 
we the multiple Rs 


omplished across a large num 


attained 


illeges with a sample having a nar- 
talent. Further, the zero- 
er correlations for 


Vn in lal le 4 are 


inge ol 
individual COLIeCLeS 
substantially higher 


AcTOSS colleges in 


USSION 


Verbal and Math fac- 
about equally efficient 
rades. For the CPI, the Sp 
id Fe scales h 
both 


ive useful pre- 


Re, Ac, 


lictive validity, alone and in com- 


bination with the SAT. The Sp and So 


scales appear more efficient, since th 
related to grades for 
ges. The 


unt correlation of the CPI 


significantly 
otal samples across coll 
So scale with 


grades in all 


1955 


four major samples supports 


Gough’s theory that achievement 
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and underachievement among gifted per- 
SONS 18 & sper ific facet of the general prob- 
lem of socialization 

These results generally support Gough’s 
(1955, 1957) findings, but they fail to con- 
firm the validity of the Ai and le scales 
However, the high aptitude levels and out- 
standing high school ac hievement records 
these 


unexX- 


of this sample may explain 
pected variations, particularly the relative 
of the Ai 
expected predictive 
Pre sence Cap 
bilit ales 


failure 


and I Sscu 


our 
filed Ising 
highest 
samples 
which are elevated 
ard deviations abo 
Scholars and Certifi 
usual high s hool 
HSR is about 99 
Near-winne! 
students 
homogeneit 
reduce 
other CPI 
this study 
When the 
the CPI 


how 


an 
also 


one be« Lust 
testing and th 
ministration ol 
over, the Sx 


used as as 


7500 166.000 


pool of 


participants rit pro- 
gram. Asa | 

the SAT wa 

of students 

similar in content 
selection of the fi 
probably attenuate 
tained for the SAT 
as a screening devi 
known to the 


seems likely that sel 


students 


tion on e basis of 


OF COLLEGE GRADES 14] 


SQT scores attenuated correlations for the 
CPI less than correlations for the SAT 
Probably more important than the ques- 
tion of the relative efficiency of these tests 
is the finding that at a high level of scho- 
lastic aptitude, personality variables may 
vield validity coefficients which are two to 
almost three aS those ob- 


times as great 


tained iptituds alone 
Whether this would be tru 


ments were 


using measures 
if both instru- 
devices is, of 


used As le ctive 


known Dhe nt eviden e 


to t! 


course, not pres 
it of most academi 


report that the 


contrasts sharph 
prediction studies, whicl 


usually 


addition of a personality variablk 
adds oni i rel vely small 
the aptitu rades cort 
s the 


bination of hi | 


increment to 
ition uf it in- 
creas correlatiol all. Using a com- 
igh school rank and SAT to 
inefficient 
ent aptitude level 
In a similar study of National Merit Schol 
in 1956 (Holland, 1958), it was found 
that SAT-V, SAT-M, and HSR produced 
multiy Y R non-cToss-\y lidated, of only 
16 for a total m of 394 scien 


lf tl 


elatively 


predict grades 1s also 


ior sampies of the pre 


rs ' 
i 


} 


majors only: this resul ynlv one-} 


ilidater 1957 male 


cTOSS-\ 


sample 


i sample 
Mul- 
tipl CPI and 
SAT in « nation ¢ und the 
resulting multiple Rs are two to three times 


in grades for 


school set 


gh aptitude high iors 
regression juations for the 


ross-Validate, 


r’s obtained for 
( PI \ iriables 


as great as tl zero-order 


the SAT alone. Although 
are general 
les In 


’ 
ual scales in 


varial 


variation in V 
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THE RELATIONSHIP OF INTELLIGENCE AND ACHIEVEMENT 
TO BIRTH ORDER, SEX OF SIBLING, 
AND AGE INTERVAL! 


SARAH M. SCHOONOVER 


Northwest Guidance Center, I ma, Ohio 


This investigation is a supplement to the Stanford-Binet test and on the Stanford 
writer’s previous study of resemblances in Achievement test, from the fall of 1929 
the mental and educational ages of siblings through the spring of 1951, were used in 
Schoonover, 1956). In the original study, this study l hese qualifications, 59 
three different methods of analysis of longi- sibling pairs were found for intelligence: 
tudinal growth 1 rds, i.e., means of the 64 pairs for arit! tic, education, reading, 
average differences, percentage reduction of and spelling; 42 pairs for literature and 
difference by tamil nembership, and cor- c | lies: rs { nguage: and 
relation produced eviden f : bstantial < ir science ra ional details 
amount of sibling resembla n intelli- 


gence and achievemen mb he act : t irlier report 


slieence © mewhat greater th: vonover, 1956 
MertTHops FOR THE COMPARISON OF 
LONGITUDINAL SIBLING REecorRDs 


ided in this st iv a 
‘ ld to ne! t perform é I l graph ar ight achieve- 
h Wi it 1 1 el ( s} | i the \ I ment r { grap! were constru ted 
child’s sibling to his mental test forn ‘hi ant that . g graphs and 
ance? (c) What is the relationship between 757 individual growth curves were plotted 


age interval and degree of resemblance in rhe linear equation best fitting the data 


f ail 


mental achievement of si 


lings was found to elimin: the observed vari 


Studies involving familial resemblances ation and to determin me constant rate 


in mental ability have been numerous dur- of growth which 1 be used to character- 


ing the past 90 vears. The contribution of ize the observed r t h juation of a 


the above investigations is that they em- straight li yl a », which gives the 
ploy the longitudinal approach to this lope and the intercet e used to 
problem in a manner that has not been describe ie growth-age relationship, was 
utilized with data analyzing sibling resem- found by the method of the least squares 
blances in intelligence or achievement fit. The linear fit for each child for intelli- 


gence and for each of the eight achievement 
SIBLINGS SELECTED FOR STUDY variables was plotted graphic ally 
The data were obtained from the records For each pait of siblings the limits of the 


f 


of the University Elementary School at overlap of their chronological ages were 


the University of Michigan. All true sib- found, and from these the midpoint of the 
ling pairs, with chronological age overlap, age overlap was computed. From the linear 
and with four or more scores per sib on the _ best fit, the age scores of each sibling were 
vee wstter in indebted to Wited C read at these midpoints. By subtracting 
Olson and to Byron O. Hughes for their 

criticisms and suggestions in the prepara overlap from each sibling’s chronological 


the score equal to the midpoint of the age 


tion of this manuscript age score, the average difference for the 


143 
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overlap period was found 
child’s 


age score difference 


achievement 
from the theoretical 
norm was obtained. The means of these 
differences calculated the older 


siblings and for the younger siblings 


each mental and/or 


wer lor 


the 


mental 


| sing the method described above, 


means of the differences between 
achievement 
of the 


calculated 


and/or scores and mid- 


ure 


points chronological age overlap 


were for sibs with brothers and 
for sibs with sisters. To ascertain the 
liability of the differences 
sib-pair means, ¢t tests were ¢ mployed 
The 


months and the midpoint of the age over- 


between 


chronological re differet in 


lap was found for « From 
best ht, 


sibling were 


ich sibling pair 
the age 


ol eA h 


rhe 


we for each sibling pair was 


the linear scores 
re id 
differet 
found by subtracting the 
from the 
efficients 


at these midpoir ts 


average 


smaller age scort 


Correlation co 


ane 


larger SCOrE 


were computed to dis 
re lationship between the chronological age 


difference and the 
for the sibling pairs 


iverage score difference 
\ Pearson product- 


moment formula was used, test 


as was al 


of an observed correlation 


FINDINGS 


Older and yo 
secured by the 
the 


comparison of the 


inger siblings results 


means ol 


] ] 
ITOnOLOZICAL 


ave! differences from cl 


ue 
TABLE 1 

MeaANS OF AVERAGE DIFFERENCES 

CHRONOLOGICAL AGE NORMS 


AND YOUNGER SIBLINGS, 
IN MontTHS 


FROM 
FOR OLDER 
EXPRESSED 


Mental or 
ment Ag 


Older Sib 
Mental 

Arithmetic 

Education 

Language 

Literature 

Reading 

Science 

Social studies 


Spelling 


In other words, 


SCHOONOVER 


TABLE 2 
Means OF AVERAGE DIFFERENCES FROM 
CHRONOLOGICAL AGE NORMS FOR SIBLINGS 
With BrRoTHEeRS AND SisLincs WITH 
SISTERS, EXPRESSED IN MONTHS 


al or Achieve Sibs 
t Age Mea 


wit! 
Brother 


Mental 
Arithmetic 


duc 


26.‘ 


ition 


rms fer older sibs and for younger 


lable 1 


y 
10 


ire given in for intelligence 


nd achievement. 

Phese 
sistently 
diffi 
ea other 
be reliable 

Phese 
of Hsiao 


ind Griffitts 
| 


and siblings con- 
found to have 


rences that 


older younger 


were means OI aver- 


uge were very 


similar to 
h No differences wert 


at th 


found to 
05 level 
findings are in accord with thos 
1931), Jones and Hsiao 
1926). Tl incongruent 
ol 
Willis 
1954 


Ssampies, 


1928 
wey are 
1 those Thurstone and Jenkins 
(1924), and Koch 1954 

has pointed out that in 


when methodological 


wit 
1929), 
Jones nor- 
difficul- 
birth 
rhe 


study not only support this 


are adequate vy controlled, no 


r differences in intelligence occur 


indings of this 
viewpoint but, in addition, reveal no birth 
order differences in achievement 

Siblings with ! 


Phe 
varison of the 


yrothers and siblings with 


sters results obtained by the com- 


differ- 
norms for sibs 


means of the average 
ences from chronological age 
and for sibs with sisters 
Table 2. 

gs with brothers consistently were 
to 


with brothers are 

shown in 
Siblu 

found 


differe! 


have larger means of average 
than In 


other words, sibs with brothers had higher 


ces siblings with sisters 
scores than sibs with sisters in all mental 
The differences 


significant 


and achievement measures 


between these sib means wer 





SIBLING INTELLIGENCE AND ACHIEVEMENT 


at the .01 level or lower in language, liter- 
ature, science, and social studies, and at 
the .05 level in arithmetic. The sib mean 
differences in intelligence, reading, educa- 
tion, and spelling were not significant at 
the .05 level 

These results substantiate those found 
by Koch (1954 
with those secured by 
(1954). 
that the possession of a male sib appears to 
test Koch 
pointed out that possibly the more a 


and are in disagreement 
Tabah and Sutter 
As an explanation of the finding 
influence performance, has 
vigorous, and competitive male alerts 
than does the 


Sive, 
his sib to a greater extent 
more passive female 

score diffe rence 


ured by the 


oefhicients for chron- 


Age interval and average 
for siblings The results sé 
method of correlation ¢ 


ological age interval and average score 
difference for 
Table 3 No 


interval 


given in 
found be- 
score differ- 


orrelations ranging 


sibling pairs are 


relationship was 
tween age and averag« 
for siblings, with 


0.09 to 


ence 
from +0.18 for the nine mental 
and achievement measures 

It may be observed that thes 
each 


value of the correla- 


correla- 


tions substantiat« other and give 
some indication of the 
tions in the population, since they are all 
in a relatively narrow range 

These findings are harmonious with those 
1931), Finch (1933), and Rich- 


On the basis of the above 


of Conrad 
ardson (1936 
results, it appears that variations in birth 
intervals are without influence on measures 
of intelligence and achievement 

As a suggestion for further research it 
may be pointed out that if a large number 
of comparable longitudinal sibling records 
could be secured, the interactions of the 


variables, i.e., ordinal position, sibling’s 


sex, and spacing could be investigated 


SUMMARY 


An analysis was made of sibling per- 
formance on intelligence and achievement 
tests utilizing longitudinal data. (a) No 


significant differences were found between 


TABLE 3 
CORRELATIONS BETWEEN BIRTH 
AND DIFFERENCES BETWEEN 
IN MENTAL AND ACHIEVEMENT 


INTERVAL 
SIBLINGS 


AGES 


Mental or Achievement Corelation Coeff ° 
Age Measure emu seThncien 


Mental 03 
Arithmetic 18 
Education 00 
Language ll 
Literature Ol 
Reading 09 
Science 07 
Social studies 03 


Spelling 07 


older and y siblings in intelligence 


unger 


or achievement deviation 


! 
as measured by 


from the norms for chronological age. Thus 


priority ol birth in a family gave no ad- 


vantage in intelligence or achievement. (6) 


Sibs, irrespective of sex, with brothers con 


had higher 


ment ages than sibs with 


sistently mental and achieve- 
sisters rhe 
relationship between interval between 
births and the average difference in intelli- 
and achievement for sibling 


gence pairs 


was insignificant 
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Current concern regarding the adequacy Christensen, 1953) might be regarded as 
of our scientific and technical manpower an investigation of the process and product 
has stimulated considerable interest in the aspect of creativity. Gough (1955), Stein 
area of the intellectually gifted. The press- and Meer (Stein, 1953; Stein & Meer, 
ing need to identify and encourage those 1954), Barron (1953), and Drevdahl (1956 


students who are cap: \igh-level per- have all examined personality factors rek 


formant ha i attention to the vant to creative effort. These studies in 
techniques for ognizing the dicate an independence or self-assertive 
dividual as ear I i ol eer ¢ factor as characteristic of creative individ 
possibl ials. However, the a f originality is 

A study of creativity of the intellectual] popularly associated with extreme social 
gifted is one approach he larger prob- isolation, intense a ivate self-search 


phasizes the 


lem. Creativ my ing: the picture of the artist shut up in his 


originality asp f giftedness. The limited garret, the withdrawn writer, the scientist 
research on creativity has approached the wrapped up in his world of formulae and 
study from three views: the ative proc- test tubes. Little objective evidence for the 
ess, the creative product, and the creative reality of the tr 

personality. The er ve act appears to | adjustment | 

the result of a complex int n,u hicl occasional life 

a number of ne ry con ns have be some creative 

met. These conditions include: The major question investigate: 


study is whether high school students se- 
A basic minimum of intelligence (one 


, ; as creative and ¢ jually ible high 
lat 1s considerably higher than aver : 
s hool stuck nts s lected as noncreative 


int 


2. Skill in a particular led “‘tal differ with regard to (a) self-attitudes, (b 
ent “technique or “‘technical abil sociability rhe relation to creativity of 
ty intelligence, socioeconomic status, parental 


3. Training and/or experience 


sn which there is occupation, and parental education was 
4. An opportunity t til , also studied 
1,2, and 3 
5. The personali risties ih: Metuo 
ioe oodhende The initial sk involved the dev lop- 
ment a ti ique for the identification 
rhe factor-analytic studir i I } ati ind noncreative student 
and his associates (Wilson, ilfor view of the iability of the expression 
1 This paper is adapted f1 It creativity ‘ d advi vl to employ) 
tion submitted in partial fulfillment of , & procedure bas ipon extended observa- 
requirements for the degree of doct« tion of the students 1 iived. Nomination 
philosophy under the Joint Committee on by teachers was adopted as the procedure 
Graduate Instruction, Columbia Univer 
sity. The author wishes to thank Arthur T 
Jersild, Millie Almy, Irving Lorge, an 


variability into 


ativity used by 


, 
Wayne Dennis for their encouragement and chers when making the hominatior 


assistance 
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1954 
was completed by 225 teachers from high 
schools throughout New York City, 
vealed 14 criteria of creativ- 


these were 


critical incident (Flanagan, form 
and 
the analysis re 


ity. In summary, 


1. Gives work 


Will venture into unfamiliar or 


a ‘“‘personal touch’’ 
new 
areas 

Is sensitive the potentialities of 
media 
Works 


Demonstrates judgment on the basis 


with enthusiasm and ple isure 
of pe rsonal standards, a sense of ap 
propriaten¢ and taste 


Is able to “‘let himself go’’ and freely 
yurce of stimulati 


for self-direction 


respond to the s« 
Displays i: capacity 
and independence 

Simplifies a complex task by perceiv 
1 emphasizing the essential 
knowle 


prol lem in a 


ing a! 
Uses pa 


present 


terpret a 
that 


dge oOo im 
manner 
original and meaningful 
Displays ju lgment and foresight it 
planning work 


ind tests the | 


tion imp! 


ids when to give 
leaa that « . ‘ 
1dea 14 eem impractte 


; : 


1de¢ n 


ipproach to problems 


jua 
Flexible in 
Demonstrates imaginative and ¢ 
nal 


rig 


solutions to problen 


he nominating teacher attended a trair 


ing conference during which the criteria 


and each was then directed 
students 
students 


were disc ussed 
to select ative 
noncreative 


basis of the 


five intelligent, cre 
and five equally ible 
in his classes on the criteria 
If he could not nominate 
TABLE 1 
DISTRIBUTION OF 10TH 

STUDENTS NOMINATED AS CRI 
NONCREATIVI 


litTH-GRADI 
ATIVE 


AND 
AND 


Group 10th Grade 11th Grade 

Creative boys 15 14 

Creative girls 17 16 

Noncreative boys 24 14 

Noncreative girl 10 16 
(Total N = 126 
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appropriately fit into each category, 


was pt rmitted to select 


The 


fewer 

a bat- 

included a modification 

Adjustment and Values 
Vance, & McLean, 1951), and the 

Social Adjustment subtest of the Bell Ad 

Inventor [wo of three 


students selected wer: 


These 


riven 


tests 


justment Bills’ 


ratings were used in the 
Neemnand 
r} "et 
was omitted, since 
vt iled ome 
students in using 
test lorm conta 


ling parental education 


difficulties 


sociometri« 
vhich the 


quest 


nominees 


subjects 1 to an analysis 
126 Ss were separated into 
ups according to creativity (creative 
I reative), sex, and grade (10th or 
Lith grad 


ll subgroups, 


This resulted in ¢ ight un qu il 
lable 1, 


required an analysis of variance of 


summarized in 
whi h 
cell means. Since responses to the SOC10O- 
available for the 


metric questions were not 





grade class was studied for 
of student evaluation of 
tiveness. This class, di 

the highest I 


stude! 


In 


‘OMPARISON OF 


Self ¢ 


ntire 10th 


AS 


CREATIVITY, SELF 


Lith les, 10th- 


a rough index 


and gra 


om 


peer 


ignated 


attrac- 
4-H”’ had 
with 17 


sOocla 
imber of nominees, 
ts represent d 


all comparisons the .05 lev 
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taining means and standard deviations for 
the creative and noncreative students, with 
th separate but the 
bined. Tabl 


VSIS ol 


SCACS grades com 


3 contains the results of th 
variance b: the c 


ised on Lis 


les ribed in | iit 


if rences 
luations o 


were 


TABLE 2 


THE ( 
IE VIDENCED IN THI 


REATIVE A 


MEANS 
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AND STANDARD 


r 
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ce} 


Ideal-Self 


Self 


Sociability 


te 


Ideal discrep 
Bell 


lowa 


IQ 


Se 


ny 
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Cre 


Se 
Cr 
se 
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Within cel 
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x 
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Pintner 
Ve are 
TABLI 


CIABILITY ™ 


AS CREATIVI 


de 


ativity (Cr 
YS Cr 
x Grade 
x Grade 


xX Grade 
Is 


lot il 


NONCREATIVI 


Boys 
DEVIATIONS OF 


AND GIRLS (GiRADI ( 


Vi 


OMBINED 


MEASURES* 


THE St! RAI 


Girl 
Nor 
Sp 


Vf Sp 


15 


4 244 
280.69 ll 


4.46 14 


S&S } 


92 15.28 
6 
61 


ll 


05 
4 
15 
5.06 5D 


54 $. $2 


19 
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2s 


16.24 
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RES, lowA 
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TABLE 4 
COMPARISON OF THE C 


I aiso were lected more often 
REATIVE AND i reativit) These 
NONCREATIVE 5ST! GRADI ident it 
EVIDENCED IN THI “ 

OF THE SOCIOMETRI 


the .05 leve The 
rt 
MEASURES* 


DENTS 
COMBINED 


MEANS 


pos- 


aifferences 
n 


4 were sigi 


‘ 


otes for tl rea 
students came from both their creativs 


nor 


tabili 


On the 
id sig? 


ittere 
e was m 


two grades 


ificant sex diffe 


students 





postgraduate school. The 


all creative 


When the self-attitudes 
students nominated 
noncreative 


stereotypes reputed to ch: 


mon 


the 


stantiated ecognizing procedural 


CREATIVITY, SELF 


score for 


average 


students’ parents was 2.6, and 


parents 


DISCUSSION 


and sociability of 


creative or 


of th 


as eitnelr 


were studied com- 
iracterize 
not sub- 
limita- 
1 selection 
ol 
group 
minated a 


lower OI 


might b 


mon 


Hows 
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also does not support the common concep- 
the 


interest in 


tion of antisocial creator. However 


and capacity for social inter- 


action do not preclud 


moments of intense 


isolation and concentration so necessary for 


creative work. Rathe r, the creative student 
capable of both concentration 
It must be acknowledged 


self may be 


appears to bi 
and socialization 
that the teacher 


a form of sociability 


nomination it 
ndex. Thus, we may 
f hy] 


group of sociable 


be studying a 
Whether another group of 


creators 


quiet, seclusive 


creators not on the 


ists we ¢ 
study 


L1SO ¢ an Say 


ilthough it s iggests a 
dire mm to uture research. With regard 
to the pronounced sociability difference 
number of 

1. Lack of social 
the realization of a 


2. Lack « 


3, a 
possibie ¢ ist 
inhibit 


itive potential 


planations ¢ 
mfidence may 


4 social confidence may prevent 


f 


a functioning creativity from being nm 


ind shared | 


studer 

identical with sympathy 
$. The 

deavors it 

social confi 

may diminis! 


portant are 


difference 


with a more 
sec ms 


am 


rence 


is the major fac 
What 


Only 


some ol 
be sug 
background 
itional 


a family of somew! higt edu 
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level may play a role in stimulating cre- 
ativity. Further consideration of the intel- 
lectual climate of the home is indicated 


SUMMARY AND CONCLUSIONS 


This study has attempted to examine the 


validity of certain assumptions regarding 


personality in a high school 


One 


the creative 
hundred and 
their 
reative or noncreative, and the 


population twenty-six 
teachers as 


two 


Ss were nominated by 
eithe rc 
groups were compared with regard to self 

and certain back- 
rhe results indicated 
selected as 


attitudes, sociability, 
ground information 
that the student 
rather 


creative 


emerged as a sociable individual 


evaluating himself as more confident in his 


relationships with people, more popular 


viewed by his peers than 


and creative as 
his noncreative counterpart. The creative 
student did not differ in over-all self-atti 
tudes It was sug- 


gested that a number of trait combinations 


from the noncreative 


might be equally conducive to creativity 


The study does indicate that in the cas 
of high school students two factors asso- 
ciated with creativity appear to be social 


confidence and parents who have attained 
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level. A 


research 


higher educational 
future 


a somewhat 
number of directions for 


were suggested 
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Three Scores weights were selec 1 be ise they 


computation an iterpretation ; 


satis- 


or si 
ised with : or I riterion. This c« 
ghtings for the different onventionall idered the “‘ite1 
score patterns. For this study, con : ficient”’ and is thought of : 
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rABLE 1 

UnverR Two INTEGER 
WHEN “‘a’’ IS THI 

ALTERNATIVI 


Scores As 
SCORING 


SIGNED 
ScHEMI 
KEYED 


Three 


Scheme 


. Score 
ocheme 


Two-Score 

‘‘a’’ first +] +1 
’ second 0 0 
third 0 l 


scheme Che 


different 


the 
who would 
scores under the 
those who select both distractors a 
the keyed alternative 


a score ot U 


would under two-score 


only persons recelve 


two scoring schemes are 
head of 

rhese people receive 
the 


under 


two-scorte 


the 


under 1eme¢e 


and a score of l thre ore 
scheme 
Three Criterion Groups A 


ot sets ol 


wick variet\ 
item used to 
the re 
scoring schemes using two and three scores 
Whether the thre 
more efficient, 
efficient than the 
given set of item parameters is indicated 
by the the 
Qand —1 and the criterion scores for peopl 
who do not select the keyed response first 
to indicate th 


parameters were 
study lative efficiency of integer 


scheme will be 


efficient, or 


SCOTE 
equally less 
two-score scheme for a 


correlation between scores of 


Three examples will servi 
relationship between the magnitude of this 
correlation coefficient the relative 
efficiency of the 

The efficiency indexes for the two scoring 
the 
small positive corre lation between the 0 
Phat is, 
the mean criterion level of those persons 


must be 


and 
two scoring schemes 
when there is a 


schemes will be same 


and 1 scores and the criterion 


score of UO slightly 
the 
persons receiving a score ol 


recelving a 
criterion level o 
1 for the two 


efficiency indexes to be equal The size of 


higher than mean 


the correlation which is required to make 
the two indexes equal was found to be in 
part a function of the mean criterion scor 
keyed 
+1 under both 


of persons who rank the response 


first and receive a score of 


schemes Table 2 gives the item paramet rs 
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ase in which the efficiency indexes 
The 
scores from the three 


the same figure, .29 correlation of 

the 0 and l 

scheme with the criterion is .14 
If the correlation of the 0 and 


from the 


“score 


l scores 
three-score scheme with the eri- 
large, the 

scheme will be superior. Once 
has selected 


faced with a two-choice 


terion is positive and relatively 
three-score 
the 
first, Ss are 


tion Phe 


one of distractors been 
situa- 
y must make a selection between 
the keyed response and the remaining dis- 
tractor. If the 


item”’ are highly 


results of this “‘two-choice 
enough correlated with 
the criterion to more than compensate for 
the difference in scoring under the two pro- 
the three-score procedure 
or. Table 
conditions under which th 
the 
In this example, 
the three 
1 under the 
53. The correlation of the 0 and 
the three 


res, will be 
illustration 
three- 
index of 


the efficiency of 


3 presents an 
cheme yields higher 

ney 
the item 


Sl ane 


under score scheme Is 


two-score schem¢ 


from -score scheme 


terion is .77 


The 
when the 


two-score scheme will be superior 


correlation of the 0 and —1 scores 


from the three-score scheme with the 


cTi- 


terion is negative, zero, or just slightly 


Os 


itive Table 4 presents an ¢ 


ich the heme 


Xampie in 
two-score s« 


the 


is superior. In 
under the three 
ndex of .45 
scheme the efficiency 
ind 
with 


item 
th) 


“score 


as an ¢ iency and 
two-score 
index is .53. The correlation of the 0 


1 scores from the three-score scheme 


the criterion is .07 for this case 
For the 


then 


three examples given above, 
correlation coefficients of .14, .77, 
07 between the 0 and —1 scores from 


three 


and 


the -score scheme with the criterion 
being 


respec- 


in the three-score scheme 


more, and less efficient 


It is possible for the efficiency index of 


an item under the three-score scheme to 


surpass the index of the two-score scheme 
by as much as .41. Such a case is illustrated 





EVALUATION OF SIX SCORING PROCEDURES 


TABLE 2 
IreEM PARAMETERS FOR WHICH THE EFFICIENCY INDEXES FOR THI 
THREE-ScoRE SCHEMES ARE Equal 


Two-ScorE ANI 


Proportion of Each Criterion Group Receiv- (é Proportion of Each Criterion Group Receiv 


uch Score Under the Three-Score ing Each Score Under the I'wo-Score 
Scheme 


(a 
ing Ex 
Scheme 


rion Group 


Oi 


ciel 


TABLI 
*ARAMETERS FOR WHICH THE THREE-ScoRE SCHEME IS 
ro THE Two-Score ScHemi 


rABLE 4 
nk WuHicn THE Tw 
rHE THREE-ScO 
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TABLE 5 


IreEM PARAMETERS FOR WHICH THI 
1s .41 GREATER THAN TH! 


a) Proportions of Each Criterion Group Receiv 
ing Each Score Under the Three-Score Schen 


Criterion Group 


l 00 
Score 0 OO 
l 1.00 


Efficiency (r 


5 In this « iS¢ 


of the item under the three-sco 
is .74, and the 


“4 he me 18 30 


index under th 


An eve 
was used 
ibout the 


Two Criterior Gyre ips 
dichotomous criterion 


further 
efficiency of items under the two-s 


generalizations 


score schemes The main finding 


tudy 


three 
this part of tl 


was that the thi 
olten than hot 
than the t 


cifically, 


will mor 
to greater efficiency 
More spt 
groups are 
following can be concluded: (a) If 
that per 


score schem« 


scheme when two « 


sized criterion considered 


sons low on the en 


probability 
terion will rank one of the distractors first 
is equal to the probability that they 

other one first, the 


more efficient than the 


rank the three-scor 


St | eme will he 


score scheme for nearly all possible I 


sponses from persons high on the criterion 
(6) If persons low on the criterion who do 
not rank the keyed response first have a 
large probability of ranking it second, the 


three-score scheme will be more efficient 


than the 


persons high on the criterion who do 


only when 


not 


two-score scheme 
rank the keyed response first also have a 
large probability of ranking it second 

If persons low on the criterion have a very 


Low probability of choosing the keyed re- 


EFFICIENCY 
INDEX 


THREE-ScoreE ScHEME 


SCHEME 


INDEX 
UNDER THEI 


UNDER THI 
Two-Scort 


b) Proportions of Each Criterion Group Receiv 
ing Each Score Under the Two-Score Scheme 


Criterion Group 


l 


Score 0 


Efficiency 


three scheme will be 


first, the 


efficient unless persons high on the 


-score 


have a very high or very low 


ability of choosing the keyed response 


irison Ol 


ition coefficients 


ney for the two s 


oring schemes 


ependency of the maximum possible « 


ient on the 


number of criterion groups 


ad i} 


onsidered. The two-score scheme 


ld a coefficient of 1.00 when more 


riterion groups are utilized and 
score scheme cannot yield an 
than 


For thre 


t efficiency whe 


nm mort 
riterion used 
opulated 
coefficient for the 
1.00; for the 
Whe n 


of the two scoring 


groups are 
criterion groups, the 
three-score 
two- 


msidering 


ol course, 
it is 866 
efficiency 
thre 
on the efficiency 


relative 


emes with equal sized criterion 


ups, this limit index 


should be considered. When two criterion 
the 
ficiency index is 1.00 for both schemes 


used, maximum possible 


groups are 


Siz Ir leger Scores vs. Three Int ger Scores 


The use of six consecutive integer scores 
the 
utilize d in the three-s« ore sche me plus the 


involves the use of all information 


information on the relative attractiveness 





EVALUATION OF SIX 


of the distractors to ¢ ich other. With “a” 


keyed as the 


as the 


best answer and “‘h’ keyed 
er, the re sponse 

” oah 
assigned scores 


Such 


and 


“se cond best”’ answ 


patterns “abe,” “ach,” “bac 
might be 
1, and 0, 
of 
any set of consecutive 
to the same results 


Whether the SIX 


to an index of efficien 


“bea,” and “cha” 


resp ctively 


an assignment arbitrary, 


scores is 
integers would lead 
score scheme will lead 
v which is | irger, the 
same or smaller than that obtainable 
through the f the three 
will be determined by the 

the additional information 


signing to th 


sche me 


use « “Score 


relation 


utilized 
rl 


“second best’’ 


scores criterion 


] 


alternative “bh” is keyed 


and alternative ‘“‘c’”’ is keyed “thir 1 best,”’ 
the extent to which high criterion persons 
choose “‘b” ahead of “ce” and low ecrité rior 
pe rsons choose “‘c’’ ahe: if “b” yw 


the 


deter 
mine in efficiency of 


the 


possibl 
three-score 


1 
» « impit 


through the us« 


limited 


Consider two criterion groups for whi 


the only criterion-1 levant information is 


to te oun In ative ranking otf the 


two distractors Table 6 Both groups 


rank the keyed r sponse first, second, and 


third with equal frequency, the low cri- 


terion group always ranking “‘c”’ ahead of 
“b” and 


ranking “b”’ 


the high criterion group 


For this set of 


lict 
predict 


aiwayvs 
ah 
item 


parameters ive efhei 


of the two-score and tl ree-score schemes 
would be For 


the 


sche nt 


the six-score 


would be .29. Thus, 


inde : of ncrency 
even with rameters whi 
to the six- 


and highly improbal 


item 
tremely tavorable 
le in pra 
in efficienty is only .29 


In general, of 
of item parameters indicates that relatively 


be 


i study of a variety 


sets 


small gains in efficiency can expected 
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TABLE 6 
ITEM PARAMETERS FOR WHICH THE | FFI 
CIENCY INDEXES FOR THE SIx-Score. 
THREE-ScoRE, AND Two-Score SCHEMES 
ARE .29, .00, AND .00, RESPECTIVELY 


Criterion Group 


abe 

acb 

Response } bac 
Pattern | cab 
bea 


cba 


through the use of six integ 
than three 


r scores rather 
integer s¢ 


ores 


CONTRIBUTION OF MAXIMIZING 


WEIGHTINGS 


The procedure given by Guttman for 
determining weights whic] 
the 
was discussed earlier 
sider the 


the effi 


Wil Maximize 


wrelation coeffi 
We 
contribution of such 


the 


item-criterion < 


will now con- 


rency ol item 


The heme 
The 


cient, used in this 


7 wo-score S 


product-moment correlation coeffi- 
is the index 
ler a given scoring 
d by size of the 


Thus, 


scores 1s just 


study of the 
efficiency of an item unc 
affecte 


scheme, is 


not 
scores when just two scores are us« d 
the simpk 


efficient, but 


use oO! integer 


effi 


no more ent, than 


used 


any 


other weighting that might be the 


lor 


two scores, 
The 

The 
correlation of item scores with the criterion 


to of the 
the relationship between the item 


Three-Score Scheme 


use of weights which maximize the 


adds most the efhcienc item 


when 
responses and the criterion deviate from 
These are 


thre e- 


linearity much vossible. 
also the 


score integer sche 


as 


as | 
conditions under which the 


me has the greatest sup 


rioritv over the two-score integer s« he Int 
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We 
weights make an extreme contribution to 
the efficiency of the 
three 

groups with the item parameters given in 
Table 5 
ranks the keyed response third. The middle 
keyed re- 


sponse first with a probability of .33 and 


can examine a case where maximizing 
item 


Consider equal sized criterion 


rhe low criterion group always 
and top groups both rank the 


with never 


ranking it third 
the efficiency 


second a probability of .67, 
Under these conditions, 
for the item for th 


with 


index 


three-scor scheme maximizing 
If three integer scores wer 
in le x would be 74, 
used, it 


conditions 


weights is .87 
used, the and if two 


Thus, 
the 


scores would be 33 


wert 


under most favorable to 


maximizing weights, the in- 
the 


weights over integer weights is only .13, 


efficiency of 


crease in efficiency of maximizing 


and the increase in efficiency of three inte- 
ger scores over two integer scores is .41 

A study of a variety of sets of item pa- 
the 


mizing weights can lead to only 


rameters indicates that use of maxi- 
relativel) 
small increases in the efficiency of an item 
that obtained three 


scores are used 


over when intege r 


The Sir-Ne ore Sche me 


The use of a six-score scheme with max- 
imizing weights for the re sponses represents 
the 
that is obtained when subjects rank the 
While 


ior spe ( 


the maximum use of all information 


responses of a three-choice item 
othe 
ifiable item parameters 
that obtained by this 


conditions can they be larger 


r schemes may yield indexes 


sets of as large as 
scheme, under ho 
Che set of item parameters under which 


the use of six maximally weighted scores 
will produce the greatest gain in efficienc) 
over other procedures is that set presented 
lable 6) to compare 
ores to the 


In this case, all of the 


earlier the efficiency 


of six integer s efficiency of 
three 


information about two 


integer scores 


eriterion groups 1s 
in the ranking of the two distractors, the 
ranking “ec” 


criterion always 


ahead of “b,” 


low group 


and the high criterion group 
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always ranking “b”’ ahead of “‘c.’’ As was 
pointed out earlier, this set of item param- 
eters leads to an efficiency index of .00 for 
both a two-score and a three-score scheme, 
and this would be true regardless of the 
weightings used. Six integer scores would 
yield a validity coefficient of .29, and six 
scores maximally weighted would give a 
coefficient of 1.00. With these particular 
item parameters the advantage of this pro- 
cedure over the others is substantial, but 
this particular set of parameters is not to 
be « ype ted in practice The only conditions 
under which the use of maximizing weights 
1.00 is 


can lead to an efficiency index of 


when each response pattern is given by 


persons from no more than one criterion 
group 

A study of a number of different sets of 
item parameters indicates that for sets of 
item parameters to be expected in practice 
the efficiency of an item under the other 
procedures will not be much less than that 
obtained through the use of six maximally 


weighted scores 


SUMMARY 


In the conventional multiple-choice test 
proce dure. a subject receives a score of +1 
if he chooses the keyed alternative, other- 


wise he receives a score of 0. This study 


compares the relative efficiency of three- 


choice items with specified characteristics 


when used with six different scoring pro- 


cedures correlation 


coefficient 


Che product-moment 
between item scores and a cri- 
erion was used as the index of efficiency 


} 


Scoring schemes which utilize two, three, 


and sets 
ighted to 
with the 


utive integer scores 


’ 
onser 


und six ¢ 


of two, three, and six scores w 
lation 


rhev 


uses of (a) the 


maximum corre 


produce 


were com- 


riterion were compare d 


d on the b: information 
bh) the 


1 to pre 


par 


used in scores and eth- 


assigning 
ciency with which they can be uss 
dict membership in two or three equally 
populated criterion groups 

The 
from the study 


1. The 


following conclusions were drawn 


of added information to assign 
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an increased number of integer scores does 
not necessarily lead to greater efficiency of 
an item. It can lead to greater, identical, 
or lesser efficiency than that obtainable by 
using a smaller number of integer scores 

2. If added information is used to assign 
more integer scores, the resulting efficiency 
will be a function of the criterion-relevance 
of the additional information utilized 

3. The 


more often than 


of three integer scores will 
not 
ciency than can be obtained with two inte- 


ust 
lead to greater effi- 


ger scores when two equal-sized criterion 
groups are used 
4 The use Of SIX IU 


than three integer scores will not, in gen- 


iteger scores rather 
eral, lead to a substantial increase, and can 
lead to a decrease, in efficiency. 

5 The 


scores will always lead to item efficiency 


use of six maximally weighted 


which is as high, or higher than that ob- 


tainable by any other procedure. However, 


SIX SCORING PROCEDURES 
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the index from this 


procedure and indexes from other proce- 


differences between 


small for sets of item 
ted in 


dures are relatively 


parameters to be exper practice 


Shrinkage of cross-validation would be 


expected to make these differences even 


- 
smaller. 


REFERENCES 


MILLHOLLAND, J. E., & 
The assessment of par 
Educ Veasmt., 


Coomss, C. H., 
Womer, F. G 
tial knowledge 
1956, 16, 13-37 

Dresse.t, P. L., & Scumip, J 
fications of the multiple-choice item 
Educ Veasmt., 1953, 13, 574 


595 


psychol 
Some modi 
psy hol 
Mathematical and tabulation 
In P. Horst (Ed.), The pre 


personal adjustment. New 
tesearch Council, 


Gutman, L 
techniques 
diction of 
York 
1941 


Social Science 
Pp 251-346. 
; 5. 1958 


iquat 0 


Received A 





TIONAL PsYCHOLOGY 


INTERPRETATION OF DIFFERENCES AMONG AVERAGES AND 
INDIVIDUAL TEST SCORES 


FREDERICK B. DAVIS 
Hunter ¢ 


test scores fr ices as attributable to something other 
scor n chance when in fact they are not and 

esire to avoid attributing differences 

school psy , to chance when in fact they are not. For 


wish to ¢ | nterpreting test scores, s¢ I | factors sug 


gist or couns 


cores on the same test that were Lined r lenient level 


irst, scores a 


ifferent pupils, to 
mean scores on the same test o hievement and aptitude 
two particular classes, or to compare a | ciently unreliable as to mak« 
pil’s score with the mean score his clas tility doubtful if only 
the same test 


differences amé 


ean he interprets 


ince de Viation from a true 


st users 
differences among s 
and treated separate 


y 


Difference Between the A 
Scores Obtained by One Ind 
on One of the Tests Incl 


100 m 
Ing This |e 
tailed test of the null hypothesis may seen 
induly lenient to psychologists accustomed 
to using the .01 or the .05 levels in experi i mpi avera 
mental work. It must be rememlhx red, how- scores obtained by one individual v 
ever, that the designation of any level o score on one of the tests in 
probability as “significant” is arbitrary an iverage. For example, an indiv 
represents a balance between the test in uge score on 10 tests in the Wechs 


terpreter’s desire to avoid accepting differ Intelligence Scale (excluding 


162 





1VERAGE AND INDIVIDUAL TEST SCORES 
TABLE 1 


Part Scores or 18-YeaR-O_pb Boy on WAIS, anv DaTAa PERTAINING TO STANDARD ERRORS 
oF MEASUREMENT OF DIFFERENCES BETWEEN AVERAGE AND PART ScoRes* 


otandard 


Minimur 


: Difference 
oy’s Deviati Error of 

' eviation from 
Scaled Score _—_ Measuremer 
Average 


of Difference 


Informatior 
{ omprehen 
Arithmetic 
Similarit 


Digit Sy 


Digit 5) 
8. Picture 
9. Block De 
10. Picture 


ll. Object 


htair 
WAIS. Whet I 1 cl 
bov’s average led e of und an be noted that if the 10 differer 
individual’s set of WAIS s 


pendently determined by 


( 


one 


termined at ar 
i difference 
inificant at tl 

unlikely that their occurr 
attributed to chance, even the 
not complet lependence in 
mination 
7 easurel 
chsler (1944. Ch ‘ a Sevens an average scor 

tea secs re aoe a ys ae vy any individual chosen at ran 
ered by Case 3 in th m from the group tested and any one of 


Ch. 11 ores that entered into his average may 
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he estimated by ] quati mn 11] 


where s # a7 1S the variance error of meas 
urement of the sum of the m part scores, 
m is th 
scores are compal ible, T /m is the average 
of th comparable part scores, and Smeasz, 
is the variance error of measurement of any 
one of the comparable part scores, Some 
times it is convenient to obtain 8meas, by 
summing the variance errors of measure 
ment of the part 


of the fact that 


scores, 


T 


difference between an indi- 


Whether the 


vidual’s iverage Of m comparable scores 


on one ol the ” 


parts 18 sig 


zero at any ae 


and his score 
nificantly different from 
sired level may be estimated with servic 
when the 

] 


vas computed in a larg 


able accuracy standard error of 


measurement 


sample by means of the critical ratio 
CR 

Differences between an and 
scores on any one of the tests included in it 
to interpret only if th 
separate vield 
The latter are de fined, for purposes of this 
paper, as transformed obtained scores for 


average 


are convenient 


tests comparable scores 


which the corresponding points in the dis 
tributions of true scores are exceeded by 
the same percentages of examinees in a de 
fined sample. The transformation is made 
simply to cause the comparable scores to 
It is not 


sary that comparable scores be measures of 


be numerically identical neces 
the same ability or that they be equally 
reliable. Serviceable 
comparable scores, as so defined, may br 


approximations to 


obtained by the method described by 


Flanagan (1951). They have been pro 


number of parts for which the 


thus making use 


DAVIS 


vided, though by a different method, for 
scores on the parts of the WAIS. 
Derwation of Equation {1}. Let T repre 
sent an individual’s total score made up of 
the sum 


may be 


of m part scores, any one of which 


denoted as J. Then 
T =, ++ + M 


the average of the part scores Suppose that 
an indefinitely large number (n) of equiva 
lent forms of the m parts were administered 
to one pupil chosen at random from a group 
the tests are 
postulate that the pupil’s true score in 
each of the abi remained 
constant throughout the testing. A distri- 
between the 


for which appropriate, and 


lities measured 


bution of the n differences 
pupil’s m average scores and his n scores on 
any given part would be produced. These 
differences would be normally distributed 
around a mean approaching (7',/m) — I, , 


difference between the pupil’s true 


mean and true score. Since it was postu 


that the 


remain constant, oT, 


lated pupil’s true scores would 


=o;, = VU. Conse- 
m 


quently, the population variance of the dis- 
tribution of differences may be written as: 


- OF 


9 
“OT, 71, P(T, I 


m 6 


where the subscript e denotes error of meas- 
urement, o* denotes a population variance, 
and p denctes the product-moment corre 
lution coeflicient in the population 

It can easily be shown that 


In practice, if the variance errors of meas 
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urement have been computed on the basis 
of a large sample, they may be used in place 
of the population variance errors of meas 
urement in Equation [5]. If scores on all 
parts of total score T in Equation [5] are 
comparable, we may denote them with the 
capital letter Z and write 


87, = Smear 
8(ZaatZ pet 


SZAae T SZB 


Smeasz 


“J 


intercorrelations of the errors of 


‘arate tests approach 


since the 
measurement in st 
zero for an indefinitely large number of 
pairs of scores administered under proper 
conditions 

By definition, Smeasz, =. Pe 
The transformation of ra’ 
defined 


the 


scor s to com 
has no 


parable scores, as above 


appret iable effect on correlations 
with other variables; hence, ry; Var, 
if we assume that transformation to have 


reliability coefficient of 


} 
no effect on the 
part-score I of total score T. Then: 


8] 


substitutions of 


By making appropriate 


these values in Equation iation [1 


1S ¢ asily obt Lint 1 


{ Diff rence Bet een the 


Obti 


Case 
Sere 
and His Score or 


the Averagi 


The Vocabulary 
WAIS scores 
1 was excluded fi 


his average scal d score 


ral Neores 


whose 


product moment correlation vi ul 
in the Voeabul y I ind 


led score would be 


measurement 


Insig 


in his average sca 


nificantly different from zero if an indefi 


large number ot equiy ilent forms of 


nitely 
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If we 


assume this correlation to be zero, as is 


the test were administered to him 


customary, the analogue of Equation [3] for 
the population variance error of measure 
ment of this difference between the average 
of several scores obtained by an individual 
and his score on a test not included in the 
average may be written as 

oy 


Fmeastim)-v) = FT, 


This leads to Equation [6], which may be 


estimate the standard error of 
this kind 


when a large sample is used in computing 


used to 
measurement of a difference of 


the variance errors of measurement 


Smea 

T Smeasg 
’ “¥ 
m* 


value vielded by Equation 16) may 


The 
be used in a critical ratio analogous to 
Equation [2] for determining the statistical 
significance of a difference between the 
average of several scores obtained by on 
individual and his score on a test not in 
It should be 


such differences are inconvenient to 


cluded in the averag: recalled 
that 
interpret unless all of the tests yield com 


parable scores 


Average 
us on 
One Test and the on the Test 
of One of the Individuals Included in the 


Case 8: A Diffe rence Betwee n the 
; f Several Specified Individu 
Score 


Score 0 


Same 


Average 
At the end of the school 
pupils in Miss ack’s sm 
class obt the followin 
raph Meani 
Test 


Test 


Stanford Interm 
iy rm J 7 

35. The 
the standard deviation of s 
The 
difference bet 
chosen at rar 


average 


standard error 


scores, 


} 


may ™ estimated by 
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where N is the number of pupils whose 
scores were averaged, and a large sample 
was used in computing the standard error 
of measurement. 

The standard error of measurement r 
the Stanford 


6 grade score 


ported by the publisher of 
Paragraph Meaning Test is 
points in a sample of 243 fifth-grade pupils 
in which the mean grade score was about 
58 and the standard deviation was about 
For the diff 
between the mean grade score of the 10 


19 grade score points. 


rence 
pupils and the score of any one pupil in 
Miss Black’s class, 
standard error of measurement of 5.70. To 
determine the smallest difference 
cant at the .15 level, 5.70 may be multi 
plied by 1.44, is the 
critical ratio when the standard 


Equation [7] yields a 
signin 
which approximaté 
error of 
measurement has been computed in a 
sample as large as 243. The result (rounded 
to the nearest tenth) Thus, 
81, 72, 51, 47, 43, and 35 are 
found to be significantly different at the 
.15 level from the average of 60.80 
Derivation of Equation [7]. Let Xi4 , X; 

-++ , Xiw represent the raw scores of each 
of N pupils on Form 1 of Test X, and let 
X, repre 
Assume that 
(n) of equivalent forms of the test are ad 


is 8.2 only 


scores of 97, 


ent the mean of these scor 


an indefinitely large number 
ministered to the same N pupils, and postu 
late that the true score of each 
mains throughout the 
Then Xo4, X34, °°° 
tional raw scores of pupil 


scores of the N pupils. For any pupil, s 


pupil re 
constant testing 
X aa Tt present addi 
A, ete 


represent additional mean 


and 


Pupil A, an essentially normal distribution 
of differences will be produce d between the 
mean of the n means and the pupil’s scores 
on successive forms of the test. The mean of 
this distribution of differences will approach 
x, : oe whereX, is the true mean of 
the N pupils and X,,4 is the true score of 
Pupil A 
true score of each pupil would remain con 


Since it was postulated that the 


stant throughout the testing, the variance 
of the distribution of differences is gener 
ated only by errors of measurement and 
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may be written as: 


7 


” "Ze T OX, 


9 fa] 
— £03 0 \ 
OF x PT xe | 


where oy, is the population variance error 


of measurement of the mean, ox., is the 
population variance error of measurement 
of Pupil A’s score, and pz_,_, is the corre 
lation of the errors of measurement in the 
n successive means and the n successive 
raw scores of Pupil A. This correlation may 
be « xpre ssed as 


The 


the mean 


measurement of 
as (Huffnaker 


variance error of 


may be written 


1928) : 


It is well known that for any pupil drawn 
at random from an indefinitely large sample, 
=o y(l — prx 
10], and [11] are substi 
the latter reduces to 


If Equations [9], | 


tuted in E 


juation te 


vhose 


number of 


averaged 


pupils 
SCOTeS ere 
The population variance error of meas 
Ay » estimated as 

N pP8meosy (N; 

where N; 
sample in which smeasy Was computed. It is 
interesting to note that ul Np N, 


tion [12] } 


the number of pupils in the 


Equa 
ecomes 


2 2 


Smeas x = Smeasy 


XA 
In practice, if 8measy has been computed 


on the basis of a large sample, it may be 


used in place of omeasy in Equation [12] to 


} 


obtain Equation [7] 





1VERAGE AND INDIVIDUAL TEST SCORES 


Case as A Difference Between the Average 
Score of Several Specified Individuals on 
One Test and the Score of an Individual 
Not Included in the Average 
A fifth-grade pupil not in Miss Black’s 

class was tested at about the same time as 

the members of her class with the same 
test. His grade score was 69. The standard 
error of measurement of the difference be 

tween his score of 69 and the mean score 
of 60.80 in Miss Black’s class may be esti 


mated by Equation 13] 


Since the standard error of measure 
of the Paragraph Meanu 
score points, | 


ment 
g Test is 6 grade 
Auation [13 elds a stand 
ard error of measurement of differenes 
of 6.3 between the averag 
and the score of the pupi 
the average. The | 
nificant at the .15 

points (rounded t 


HO. SO 


score ol 


included in 


we conclude that the 


69 1s not 


Signilical 


average score in Miss 
pupils 
12 } 


Equation [13] is deriy 
ner as Equation [7], bu 


Equation [S] 


naogute 
n its deriy ion includes 


variance term that eq 


Equations [7] and 3] diff 
| l 


Case 5: A Differen 
Score of a Re resentative Sample of a De 
fined Pop lation and the Score on the 
Same Test of a Particular Individual Not 
Included in the Sam} 


Between the Ave 


rage 


A twelfth-grade pupil, tested early in 
November, obtained a si 


Spr 1 of 


iled score of 68 in 
the Davis 
deter 


Comprehensior n 
Test, Series 1. To 
whether his score differs significantly from 
the av of the yup of twelfth- 


grade pupils, Equation [14] may be 


Reading ine 


erage norms gr 


used: 


sy Vy ) 14} 
4 Wu 3 V2-i17-.,—~C 


X-X# 


more 
a test 
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where sx and N are, respectively, the vari 
ance and number of pupils in a representa 
tive sample from a defined population, Xp 
is a particular individual not included in 
this sample, and Np is the number of pupils 
in the sample used to compute Sneses 
The norms group of twelfth-grade pupils 
tested in September and October of 1957 
vhich the 
mean and standard deviation of Speed of 
and 7.1, 
standard error of meas 
test manual as 2.9 
of 1096 twelfth-grade pupils in 


and standard de 


included 5596 boys and girls in 


Con prehension scores were 71.7 
The 


urement is given in the 


respectively. 


in a sample 


which the mean viation 


I 5 and 7.3 
data, Equation 114] vields 
the 
score of 7 norms group 
that is significant at the there 


to the nearest tenth), we 


were, respectively, 73 For these 
of 2.90 


the 


a value 


Since smallest deviation from 
average 
» level is 


tore 


4.2 (rounded 
| 


cannot conclude that the 


pupil’s score ¢ f 


68 differs significantly from the average 


score of pupils at hi 
It is obvious that Ex 
tility for establi 


het we 


eral 
of a dillerencs 
j 


lom defined 
population and the score of a parti 
It may be noted that 
sample is ver the 
{1 will be esse 


standard error of 


sample drawn at ranc from a 
uiar 

hen the 
ielded by 


ntialiv thy 


indiv idual 
large, value 
Equation same 
as the 
the 


ance of means in | quation 


measur nt of 
s obtained score. T! 
[14] is tl 


ples dr 


individual 
the means of successive san awl 
random from a defined population, wl 


it is that of the means of 


in Equation [13 
th same sampk of individuals on successive 


equivalent forms of the same test 


Case 6: A Difference Between the 
Scores of One Individual on n I 
Forms of Test X and onm E 
Forms of Test Y, When 


YX and Y Are Comparabli 


Scores 


Ilracy Of mé 


of the 


To increase ac sure! 


alent 


administered to one indi 


than one equi forms 


may tx 
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It is well known that the standard 


error of measurement of the mean score on 


vidual 
n such forms of, say, Test X is 
15 


It can easily be shown that the standard 
error of measurement of the difference be 
tween the mean of n equivalent forms of 
Test 
the mean of m equivalent forms of Test } 


X administered to one individual and 


administered to the same individual or to 


another individual can be estimated by 


Equation [16 


If the which the 
variance errors of measurement in Equa 
tion [16] a 


equation may be 


numbers of cases on 
re large, the value yielded by this 


used in a critical ratio 


analogous to Equation [2] for estimating 
the statistical significance of the differencs 


between two means of equivalent forms 


Between the Mear 
T% st of Two Pr rlu al Ir 
Partially Overlapping Groups 

pping I 


Case 7: A 
Score s on the San é 


» 
Diff rence 


Miss Black’s fifth-grade class of 10 pu 
pus is one of 14 fifth-grade classes in Smith 
ville. The mean grade score of the 245 pu 
pils in these classes was 64.00 when thev 
were tested with the Stanford Paragraph 
Meaning Test on the same date. Whether 
the difference between the mean score of 
these particular 245 pupils in Smithville 
and the mean score of 60.80 in Miss Black’s 
class is significant can be determined by 
comparing the difference of 3.20 grade-score 
points with the estimated standard error of 
measurement of the difference between the 


means of these partially overlapping groups ; 


This standard error of measurement may 


be estimated by Equation [17] 


FREDERICK 


B. DAVIS 


where Xs and Xs are the means and Ver 
Vs the 


group and 


and numbers of cases in the total 


subgroup, respectively; and 


Smeasy 18 the standard error of measurement 
comput d on the basis of Np cases having 
a mean and standard deviation similar to 
those in the total group 

The standard error of measurement for 
the Stanford Paragraph Meaning Test is 
by the 
points in a sample of 243 fifth-grade pupils 

value of 1.84, 

the ¢ ratio is 1.74, with 242 degrees of fre 
that the differ 
Miss 
mean of all pupils in the 14 
Miss Black’s) is signifi 
cant at better than the .10 level 

Derivation of Eq iation [17] Suppose that 
an indefinitely number (n) of equiva 
lent f X were administered to 
every individual in Group 7, and postulate 
that the 


publishe ras 6 grad score 


given 


Equation [17] yields a and 


dom. Hence, we conclude 
ence between the mean of BI ck’s 
and the 


class 


including 


ciasses 


large 
rms of Test 
, 


true score of each individual re 


mained constant throughout the testing 


If the mean score of Group T were com- 


alent forms, 


puted for each of the n equiv: 


n means would be obtained. If the mean 


score of Subgroup S of Total Group T were 
equivalent 


v ould like 
normal 


omputed for each of the n 
forms, nm means for Subgroup S 


wise be obtained An essentiall 


distribution of differs nces beween the two 


means for each form would be produced. 


The mean of these differences would ap 


proach X,7, — X 


tT denotes a true score in Group T and the 


where the subs« ript 


subscript tS a true score in Subgroup S 
variance of these 


The 
} 


expressed As 


differences may be 


where the subscript e7' denotes an error of 
measurement in Group T and eS an error 
of measurement in Subgroup S. In terms of 
individual scores, this may be written as 
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which will be found equal to 


Tmea 


Ves 
ov 


o,7? 


8 


NeNsg 


If we assume that o¢,7 is the same for every 


individual in Group T and that o¢2 Cen, 


Equation [18] raay be simplified to 


] .) 
"ins, Ws 


from which Equation [17 


Between 
V onove 


‘ase 8: A 
Scores of Two P rt dar 


Gro 4ps on Ar J artabl 


Diff rence 


The pupils in Miss Green’s class and 
an algebra 


date at 


Miss Brown’s class were given 
test on approximately the 
the end of the 


same 
school vear The tests were 


carefully administered by the same exam 
iner, whose records indicate that each punil 
coopt rated The 

rized in Table 2. Since the 


two 


well results are summa 
variances of ob 
scores in the classes are not 
different (F 1.29), we 


variances of the 


tained 
significantly 
assume equivalent scores 
in the population or populations from which 
Miss Miss Bro 


were draw n aiso Assume the se scores 


Green’s and vn’s classes 
If we 
to be distributed normally in the population 
or populations, we may test the difference 
between the 


it is significantly different from zero. The 


sample means to see whether 


t ratio is 


xX p)* 


Since ¢ 80, with 62 degrees of freedom, 


we conclude that the two classes may well 


{ND INDIVIDUAL TEST SCORES 


TABLE 2 
Scores 1n Two Ciasses 


Miss Green’s 


Class 


Miss Brown’s 
Class 


Sx 
8x 
rxx’ 


Smeasy 


have be 
parent p 
that diffe 


of classes 


‘n drawn at random from th« 
ypulation, This 
ences between the me 
of the 
Miss Brown’ 
from the 
he expected by chance 
as larg r larger than the difference of 
between tl means of Miss 
Green’s and Miss Brown’s classes. But this 


result does not tell hether a difference 


same 
result indicates 
ins Of pairs 
sizes Of Miss Green’s and 


S drawn suc ssively at ran 
such classes 


to be 


population of 


dom | 


could often 


2.18 points 


ild often occur by 
chance betwee | means these 


classes if they wer d over al 


as large as 2.18 p 
two 
id over 
nel if the 
Yet this may be 
deter 
mine this, a different ¢ ratio should be em 
ployed, with the estimated standard 
of measurement of the differenc 
the means as the denominator. It car 
be shown that the 
urement of a difference 


with equivalent forms of the test 


true difference were zero 


exactly what we want to know. To 
rror 
between 
easil\ 
standard error of meas 
between the means 
of two particular nonoverlapping groups on 


any variable, say Test XY, may be estimated 


where Smeasy Was computed in a sample of 
Np cases and Ng and Ny, are the numbers 
of cases used in computing Xo and X, . 
respectively 

The standard error of measurement of 


the algebra test given to Miss Green’s and 
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Miss Brown’s classes was computed on the 
basis of the 64 pupils in both classes, the 
mean errors of measurement being insig 
nificantly different in the two classes. For 
the difference between the means of the two 
algebra classes, we have t = 2.32, with 62 
degrees of freedom, and we conclude that 


the mean ability in algebra of these two 


particular classes is almost surely different, 


Miss Green’s class b ing superior 

As is well known, care must be exercised 
in choosing the appropriate denominator 
for the ¢ ratio. In making this choice, the 
experimenter should ask this question: Do 
I want to find whether the algebraic signs 
would rather consistently be the same for 
differences between means of scores in suc 
cessive samples drawn at random from the 
same population, or for differences between 
means of scores on successive equivalent 
forms administered to the same sample? 
If the former is desired, 
the difference between 


an appropriate 
standard error of 
means should be employed; if the latter is 


FREDERICK B 


DAVIS 


desired, an appropriate standard error of 


measurement of the difference betwee n 


means should be employed. 
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Two initial papers have reported the re- 
sults of an investigation of the effects of the 
brainstorming method on creative thinking 
(Meadow & Parnes, 1959; Meadow, Parnes, 
& Reese, in press). In this method, a subject 
is instructed to attempt to solve problems 
by recording all tentative solutions which 
occur to him, postponing judicial evalua- 
tion of those solutions to a subsequent time 
period (Osborn, 1957 

The results 
dicated that a 


one semester in 


of the first experiment in- 
class group instructed for 
creative problem solving 
methods (which emphasized brainstorm- 
ing) increased its productivity in five of 
seven tests of creative ability as compared 
Meadow & 


ond study 


with a control group Parnes, 
1959). The sec 
effects 


the brainstorming 


investigated the 
in two creative ability problems) o 


method as 


ompared 


ideas, penalty for 
utilizing the 
Results a 
performance for the 


Meadow et al., 


these experiments em 


with a “produce good 


bad ideas” instruction same 


subjects for each instruction gain 
indicated a superior 
brainstorming instructions 
in press foth of 
ploy d subje cts who were taking the course 
in creative problem solving which empha 
sized brainstorming methods (Parnes, 1958 

The present st idy was designed to deter- 
whether the brainstorming instruc- 
effective 


ver received previous 


mine 


tions would be with untrained 


students who had n 
instruction in the method. Three hypothe- 
With a group of 


ses were fc rmulated a 


untrained subjects, the brainstorming as 
compared with nonbrainstorming instruc- 
increment 


in absolute number of good quality ideas 


tions will produce a significant 


financed by a grant 


oundation 


1 This research was 
from the Creative Education I 


on two creative ability problems. (6) The 
interaction effects found in a previous ex- 
periment (Meadow et al., in press) will be 
confirmed. Specifically, a nonbrainstorming 
inhibit 
the absolute number of good quality ideas 


instruction administered first will 
produced under a brainstorming instruction 
which follows. Similarly, a difficult problem 
administered first will inhibit the absolute 
number of good quality ideas produced in a 
a test 
brainstorm- 


relatively easy problem presented ir 
If the 


ing instructions are administered to a group 


period whit h follows 


of students who have taken a one-semester 


course in creative problem solving empha- 
sizing this technique, and to a group of 
taken the 


the former group will produce a 


students who have not coursé 


cantly greater absolute number 


quality ideas than the latter group 


MetTHuop 


In order to test the first twe 
hypotheses, 52 University of Buffalo under- 
used as Ss. NoS 


SOLVINE 


S nie ts 


graduate students were 
had taken the 
course or had re 


creative problem 


ceived any training in the 
brainstorming method 

The third hypothesis was tested by com- 
group Buffalo 
undergraduate solving 
students with 
who had not taken the course 


paring a of University of 


creative problem 
courst a group of students 
Members of 
the two groups were individually matched 
on the basis of the variables of grade point 
average, age, and sex. The matched groups 
each comprised 17 students selected from 
of 21 
solving course students and 26 non 
students 

Grade point average as based on 12 cred- 


a larger group creative problem 


ourse 
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its of courses averaged 1.21, with a stand- 
50 for the 
and 1.21 with a standard deviation of 
for the 


experimental S was closely matched on t 


ard deviation of course group 
5 
ind d il 


he 


each 


noncourse group. Each 


grade point average variable with 


Phe 
of the matched pairs W 


control S mean of the differences be- 


tween each as .13 


The aver 


was 25 50, 


age age of the experimental group 
standard deviation 
the cont ol 


standard deviation of 6.80 


with a 


9 27° AV ig wwe ol group Was 


24.06, with a 
A t test 


between 


d no significant difference 
idual exper 


indicat 


these means. The indiv 
ontrol S matching was less 


Phe mean ol the 


imental versus « 


precise on the age variabl 
differences in ag 


Phere 


was 0.54 years 


wel 
xt 13 males 
rhe | 
hed on the si 


females in the 
4 females in 


not 


group 


the control group 


wer close] lat 


able; there were 9 same sex pairs and 8 


different sex pau 


This distribution in the 
matching resulted from the a 


sideration that the grade point ave 


a more crucial variable than that of 


3 ( milarity of matcl 


these latter vari 


to 


pect to 


cordingly sacrificed 
simuarity on the grad poin 


The students differed from tl 
noncourse students in having been expose: 
to a pro 


this 
Osborn’s 


course 


one-semester « in creative 


ours 


lem solving. TI 
are thos 


(1957 


e principles studied in 
course described 
te xtbook 


teaching method is the 


In 
An integral part of the 
repeated practice 
given to students in the utilization of brain- 
storming. A specific example of instructions 
for employing the method is presented in 
the Procedure 

Creative 


section 


problem solving course stu- 
dents were tested during the last two weeks 
of the semester 

Experimental problems. The Broom and 
Hanger problems used in the present ex- 
periment were selected from Part V of the 
AC Test of Creative Ability. This test 


reported to have differentiated groups of 


is 


iNVD ARNOLD MEADOW 
«& 


Irom { 


from noncreative Ss (Harris 
Simberg, 1954). Data 


previous experiment which 1 


creative 
availabk 
ited that 


are 
ndic 
scores on the Hanger } 
ith other tests which have been 


roblem are positively 
correlated v 
to 
& 
Hanger 


designed creative 


Meadow 
for the 


measure thinking 


Parnes, 1959 Instructions 


problem required Ss to list 
possibl for an ordinary rat 


uses wire c¢ 


instructions were given tor 
Broom problem 
Examiner’s Manual for th 
itive Abflity 


V, containing th 


A( 


describes two differ 


lest 
nt 
Hanger 
a “quantity” score 


score. If an S is in- 


icle without 


is 


nder the brainstormi: 


two attributes, 


iniqueness of the idea. Uniqueness of idea- 


would seem to represent, how: 
but not sufficient 
Accordingly, the 


itivity employed in the present experi- 


tion ver, a 
condition 


, 
pt 


lor 
of 


nec 


essary 


itivity 


cre cones 
ment was defined to include also a second 
attribute This latter attribut« 
broadly interpreted to include any socially 
it 


or aesthetic in nature 


value was 


useful value whether was economic, 


SOK ial 
Scores on the Hanger problem in the 


correlated with other 
Guilford’s 


previous experiment 
creative ability tests as follows: 
173; Guilford’s Plot Titles 
Guilford’s Apparatus, .301; 
Originality, .520. All but the Appa 
correlation were at the .01 level of 
significance. The correlation with the Ap- 
paratus test was significant at the .05 level 


Uses, 


152; 


Unusual 
High, 
TA 


ratus 











} 
Ir Impl 
I Tipol 


menting this scoring procedur 
each 1 sponse was copied or 1 Separate 
of paper, given a , de number, and th: n 
pres nted t the rater r ¢ tluath 
re cure was I s I is Os in- 
ria rive irg be leas 
response to brainstor g tl t 
brainstorming t tions. If ¢t] I 
scores the res 3 the original pan: 
th DY Ss, | 1) eq t I m 
iV ire ol the T t lit _ ‘ 


vhich the res e luced, Pry 
tat Ps < ate 

Med | I i t this t 
hossil 1) 

The iter tr ted t lat 
each sponse two separ teri 
( yu S t? TCE t } } thy 
resp { its r the « nventi 
us f¢ ; 1@ +} | 
t t! S ged t na 

+} ; +} r e sil 
1} 
ss. T) iniq ss attribut 2 ‘ 


BRAINSTORMING 


} itu lu 
little or no uniqui t ints indicate 
moderat p ts I 

ited 1 | ] » t! 

Liu ttribut rated t thres 
pe int s ‘ tt ’ i 1 “I rate 

i i l ma I l I ry I ses of 
testing the | t these were 

ym 1 int two le sca good 
res ~~ i I - \ p ™~ 
was s¢ ia v t : ted a 
combined scor it st 5; Le., it had t 
be at least 1 rat lal 1 mark- 
edly unique re lerats lt ind 
marks lly \ tluable 

After the responsi e indi i 
scored, t re decoded and total 
good respor re assigned to each S 
Any 1 sponse wl iup ited in essential 
meaning any other response given by the 
same S was eliminated fri m the scoring 


The 
and Broom 
previous experim« 
respectively (Mi 
Meadow et al.. in 


Procedure [lo te 





interrater re] 


probl 


tollities tor the 
ems, 
nts, were 


l le W & 


as determined 


74 


Parn Ss, 


and .9], 


1959; 


first two hypoth- 


slip 


his 





IND PROBLEM SOL} ING 

CSCS the unt! ned 
problem and then th: 
thereafter. All 
tered to each of the I 
One 


+8 were given fir 


tests wer 


group 


our sections separately 


problem was un 
ing instructions an other 
br unstorming 


storming instr ictio 


re as [lollows 
You are t¢ list the eas tl come t 
your mind itl t judging em it ny 
Wa Forget al ut the qual the ide 
entirely. We wi ( ] mily j ntity on this 
task I’xpress inv idea hich comes to r 
mind. As you go ng un combine 
Tr modify any of the ideas which you have 
ilready listed, in order » pre ee addi 
tional ideas. Remember that « it nd 
ireedom of pre ho ‘ i tion 
are the key poi: 
Ph corres} ling 1 t g ij 
structions were as f{ 
Yo re tol the , 1cle 
think p Yo be tl t 
ber t good id Do | ) t ice 
unless vo feel } ‘ 
Lhe Ss \ I | mil it r ¢ ! 
pre neTy 
Half of the Ss re g i first the Hanger 
problem and then t} Broo problem: t] 
other half were giy t problems in the 
reverse order. Simila half of the Ss we) 
given first the brainstor g instructi 
ind then tl brainstorming instr 


tions 
instr 
Gro 


ictions 


first problen nd 
under nonbrainst 


second problem: Gro 


I ] 2 Was iven the 
Broom problem under br instorming ir 
structions as its first problem and the 
Hanger under no) rainstorming instru 
tions as its second problem Group 3 wa 
given the Hanger under nonby instorming 
instructions its first problem and the 
Broom under brainst rming instructi 


] Finally, Group ty is 
the Broom under non! 


as its second problen 


given 


rainstorming 


instructions as its first problem 


ind the 


17: 


rst one 
second immediate ly 


idminis- 


ler brainstorm- 
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TABLI 


““Goop”’ SOLUTIONS FOR 


ADMINISTRATIONS 


OF 
BY 


MEAN NUMBER 
INSTRUCTIONS 


First Administration 


Instructions 
B 
NB 
No 


te 


MreAN NUMBER OF “Goop” Sout 
ADMINISTRATION, FOR 


INSTRUCT! 


BRAIN 


TABLE 


VARIANCE OF AB 
NONBRAIN 


Y 


ALYSIS 
rORMING 


OF 
Vs 
PROBLEM, I 


SUMMARY OF AN 
BRAINS 


Between S 


b 


error 
Within Ss 
Instructions 


Problems (P 
Test Period 


error (w) 18 


Total 103 


Instructions refers to Brainstorming vs 


Note 


Periods refers to the first test administration vs. t! 


AND 


1] 
BRAINSTORMING 


FOR HANGER AND Broom 


} 


0 


ARNOLD 


Administration 


R 


Nt 


AN 


MB 


NSTRU¢ 


rRATI 


ONS 


Brow 
NONBRAINSTORMI 


ER O 


TIONS 


AND 


VEADOW 


NONBRAINSTORMING 


PROBLEMS COMBINED 


Both Ad 


M 


PROBLI 


ministrations 


MS BY 


Hanger 





“BRAINSTORMING 


under brainstorming instructions 


Hanger 
as its second probl m 
1953 | ype \ 


analysis of 


Lindquist s 
variance was used for statistical analysis 
The three experimental variables, Instruc 
Prol ind Test Peri 


were within-Ss 


third 


tions ems 

second 
In testing the 

experiment, the n 


on the Hanger prol 


ing instructions 


relations ranging 
two brainstorming a 
ing groups of Ss 


nificant at the .0 


AND PROBLEM SOLVING 


TABLE 4 
CoMPARISON OF MEAN NuMBER OF “Goop” 
MatcHep COURSE AND 
BRAIN 
HANGER 


SOLUTIONS OF 
NONCOURSI 
STORMING 


GROUPS UNDER 
INSTRUCTIONS 


PROBLEM 


Course Group 


Noncourse group 


rABLE 5 
PEARSON PropucT-MOMENT ¢ 
BETWEEN ToTAL Q 


NUMBER t 


Brainstorming 
Brainstorming br 
Nonbr in 


Vonbrainstormings 


tormil 


storming 


untrained, 

two problen 

in two t 
} 


aamini 


abilit 
was 
instructior 
ministered 
structions 
later 

Phe major 
signin 
produced un 
than under 1 
(b) The 


ing coul nphasizin rainstorming 


problem 
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produced a significantly greater number of reative thinking problem, and that it is 
good quality ideas when using the tech even more effective if preceded by extensive 
nique than did the untrained students training in its use 

An additional result yielded by the anal 
ysis of data indicated a positive correlation REFERENCES 
between quantity and quality of ideas 
This correlation suggests that the efficacy 


> 


Harris, R. R., & Simperea, A. L } 
creative ability Examiner's manual 

of brainstorming in producing an increment Detroit: General Motors Corp., AC 

n good ideas is possibly the result of the Spark Plug Division, 1954 

nereased quantity of ideas encouraged by Linpqutst, E. F. Design and analysis of ez 


the method it least in a cognitive prob periments in psy holoqgy and education 


Boston: Houghton Mifflin, 1953 
em of the type used in the present experi Meapow, A., & Parnes, 8. J. Evaluation of 
ment. It is likely that in the customary training in creative problem solving. J 
course of daily thinking, some ideas are appl. Psychol., 1959, 43, 189-194 
Meapow, A., Parnes, 8. J.,. & Reess. H 


inhibited by individuals because of fear of 
Influence of instructions and problem 


criticism from self or others. The brain 

sequence on a creative proble m solving 

storming instruction, in reducing this in- test. J. appl. Psychol., in press. 

hibitorv factor and encouraging : { BORN, A. F. Applied imagination. New 

quantity ol ideas, seems to increas I York: Scribner’s, 1957 

the number of good qu ilitv ideas produced ARNES, 8. J. De scription of the [ niversity 
of Buffalo Creative Problem Solving 


The findings ( ‘rpretec ‘ dk ‘ . . 
The findings are interpreted to indicat , ‘ stive Education Office. 


‘re 
that the brainstorming instruction n ' r. of Buffalo, 1958 Mimeo 


effective method for increasing the prod 


tion of good ideas in a particular type oO 





TRADITIONAL JEWISH CULTURAL VALUES AND PERFORMANCE 
ON THE WECHSLER TESTS'! 
BORIS M. LEVINSON 


Graduate School of Education, Yeshiva University 


The purpose of this paper is to suggest tive aspects of intellectual ability (Davis, 
that differences between verbal and per 1948; Eells, Davis, Havighurst, Herrick, 
formance test scores, as well as test scatter, Tyler, 1951; Green, 1953: Levinson, 1958a) 
may be attributed to subcultural values It is further hypothesized by Hebb (1949) 
emphasizing either verbal or performance and Piaget (1947) that early perceptual 
kills. These cultural emphases are re- experiences influence intellectual develop 
flected in the school which in its curriculum ment. The pattern of successes and failures 
extolls and endows one activity with more on verbal and performance tests also tends 
prestigé thus making another activity to varv in relation to cultural needs (Green, 
appear by comparison less desirable and 1953; Strauss, 1954 Dennis (1957), for 
participation in it ego deflating. As a cast example, found in the study e Good 
in point, the scatter on WISC (Wechsler, enough Draw-a-Man test that of a grouy 
1949) and WAIS (Wechsler, 1955) of Jew of children from the same socioeconomik 
ish preschool children, elementary school background, some were prevented from 


pupils, and college studet f traditional scoring as high as others due to certain 


background will be discussed cultural handicaps. The writer (1957) has 
shown that the intelligenc of Jewish 


The Setting . 
backgrounds is 


children from traditiona 
To the traditional Jew, intensive Jewish above the average of the general popula 
education is the preferred means of main tion. It also appears from certain studies 
taining Judaism. The day (Yeshiva) schools that mental traits become more and more 
have thus been established to perpetuate diversified as the child grows older: boys. 
not only the religious identity bi also, aged, 9, 12, 15 having the intercorrelation 
the national identity (Levin of memory, verbal, and number abilities 
these schools. verv g 31 decline as follows: .30, .21 and .18 (Garrett 
upon verbal abil lative negle 1946). Further, we find that children from 
of performance art double pre m upper socioeconomic levels secure a higher 
maintained: one in English and one in _srating on verbal tests than those who come 
Hebrew. There is a long school day coupled — from lower socioeconomic levels (Eells et all., 
with additional hou f homework. Ther 1951). Attendan it school and, particu 
is little time left for extracurricular activi- larly, at college, further enhances the 
or for } ical recreation, or for differentiation of intellectual abilities 

i | scholastic Hartson, 1936; Levinson, 195S8b: Shuey 


pursuits (Levinson I 1948). The area of specialization at colleg 


I at 

P . R seems to foster the development of some 
FOrIras SN intellectual traits to the relative neglect of 
It is well known nvironmental others (Hartson, 1936 


pressure will tend to develop certain selec 
: PROCEDURI 
1A paper presented in a difierent torm sit : 
at V Inter-American Congress in Psychol Tests Used 
r\ ke exico ‘ity cemb 957 vr ‘ 
Ogy ld in Mexi ( De nber 1 rhe WIS¢ Wechsler. 1949) and WAIS 
The writer wishes to ac knowledge the = torr | } tud 
assistance of Anne Rosenbaum, who has (Wechsler, 1955) were used in this study 
tabulated some of the data The WISC (Wechsler, 1949) was adminis 
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tered to the preschool and elementary 
school children and the WAIS (Wechsler, 
1955) to college students. 
The WISC (Wechsler, 1949 
(Wechsler, both 
and verbal tests and have been standard 


and WAIS 
1955) have performance 
ized on 
population. As a matter of fact, Wechsler 
(1949, p. 1) feels that the materials of the 
the WISC 
serves the same function in testing children 


a representative sample of the 


two tests overlap and that 


as Wechsler-Bellevue (the precursor of the 
Wechsler Adult Scale 

adults (Wechsler, 1944 
writer does not wish to imply that the 


testing 


serves in 
the 


Howeve ’ 


same test items have similar psychological 


meaning or value for children and adults 


S unjects 
thre 


The 

school children, elementary 
and college students. Only 
selected who could be 
products of the cultural mold exerted 
traditional Jewish values. All the Ss chosen 
not 


difficulties 


groups compared were 
school pupils, 
those Ss wer 


considered typK il 


were “normal” individuals who wer 
known to 
would require psychotherapy 

WAIS (Levinson, 195Sb) study 
the time this research 


have personality 
which 

Since the 
was completed at 
was begun, it was necessary to match the 
pres¢ hool and elem«e ntary s¢ hool Ss to meet 
the specifications of the WAIS sample. We 
did not have enough pre school childret 
with the requisite 1Q distribution to match 
the WAIS sample. We finally matched 57 
WISC with 57 WAIS 
records so selected that the mean and IQ 
ranges of the 57 WAIS scores corresponded 
to the mean and IQ of the entire WAIS 

j 


sample. The preschool sample selected con 


preschool records 


sisted of 41 boys and 16 girls whose average 
tevised Stanford Binet IQ was 125.20, with 
an SD of 14.00 and whose average age was 
5.6 years. These were native born children 
who were candidates for admission to J 
ish traditional day schools and who came 
from traditional The full 
WISC of these children was 117.05, with 
an SD of 11.10 


Scale 


homes 


BORIS M. LEVINSON 


The elementary school boys were 
matched by pairs with the WAIS sample. 
These were 64 boys whose average age was 
11.31 and who were selected from a sample 
had attended day 
(Yeshiva) schools since the first grade. The 
full seale WISC of these pupils was 125.08, 
with an SD of 8.85. 

The Yeshiva University Ss consisted of 


of 122 children who 


64 male volunteer undergraduate and 


graduate students whose mean age was 
21.43. All these students had good 
mand of English and were graduates of 
elementary and high school Yeshiva 
The full scale WAIS of these 


students was 125.08, with an SD of 8.85 


com- 


schools 


Certain limitations regarding the sample 
borne in mind. While the WISC 
and WAIS full scale [Qs were held constant, 


} 


no allowance 


must be 


was made for possible s0010- 
and the 


bility 


economic differences 


which 


possibility 
that the 
represt nta 


was not a prol 
samples chosen were not fully 
tive of traditional Jewish youth. Further, 
whether 
performance and 
not 


dropped by the way- 


question may be raised as to 
with high 


W ho 


children low 


could compete 


verbal ability 


, 
daemicaiy were 


thus biasing the elementary school 


sample. The writer believes 


college 


that this selective factor was not 0] 


erating 
in this study for two reasons: (a 
school 
Revised Stanford Binet 1Q being 125.20; 
and (b) in the sampled Jewish day schools, 
with its population preselected on the basis 


our pre- 
sample had high verbal ability, its 


ot int lhige nee, & holastic al hieve ment de- 


pends largely on attitude, motivation, etc 


RESULTS 

means and t’s for 
school, 
University Ss. We may note that while the 
difference between the verbal and perform- 


Table 1 presents the 


the preschool, elementary and 


ince IQs for the preschool children is 
significant only at the .10 level of 
fidence, the differences for the elementary 
and University Ss are at the .001 level of 


con- 


confidence. 


We may further note that when the 
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TABLE 1 the verbal and of the performance parts of 
SIGNIFICANCE OF THE DIFFERENCES BE (a) WISC for the preschool and elementary 


TWEEN THE MEANS OF THE VERBAL AND : . : 
school ch nm an (0) 5 ‘ : 
PERFORMANCK IQs oF THE PRESCHOOL, chool children and (6) WAIS for th 


ELEMENTARY SCHOOL, AND Universiry University students. An analysis of the 
STUDENTS table indicates: (a2) minimal scatter among 
the subtests of the pre school children, the 

Nee Diff mean subtest scores ranging from 11.36 to 

13.04, (b) pronounced scatter among ele 

Preschool 117.191114.05| 3.14 1.83* mentary school pupils and college students, 
Elementary 125.08 105.27/19.8110.97** elevated verbal subtests and depressed 
School 


n , :' oh) .. performance subtest scores being charac 
niversity 25.59 105.30 20.29 10.75 


teristic of both. The mean scores of the 
° Slevsl of dheaiiene: elementary school children range from 
** 01 level of significance 10.16 to 15.16 and of the University stu- 
dents from 8.84 to 15.64 
differences between the differences shown 
in Table 1 are compared, those involving DISCUSSION 
the pre school and elementary school and 
for the preschool and University compari- The writer is of the opinion that the 
sons are significant at the .01 level of cultural pressure exerted towards verbal 
confidence (Walker & Lev, 1953, p. 158 learning has brought about this differentia- 
However, the difference between the dif- tion of ability at the elementary and college 
ferences in the instance of the elementary levels. He further thinks that somewhat 
school and University Ss is statistically similar psychometric patterns may be 
insignificant. These ¢’s are not shown in found whenever there is great emphasis on 
the table. verbal learning and a relative neglect of 


Table 2 shows the means and SDs of the performance arts. The writer (in press [b]) 


scaled score equivalents of the subtests of found such patterns among Irish, Italian 


TABLE 2 


MEANS AND SDs OF THE SCALED Score EQUIVALENTS oF THE WISC anv THe WAIS 
Preschool Elementary School University 
Mean SD Mean ’ Mean SD 


Verbal* 
Information 14.00 
15.16 
13.59 
14.00 
13.94 


~] 
to 


Comprehension 
Arithmetic 
Similarities 
Vocabulary 
Performance 
Picture Completion 
Picture Arrangement 
Block Design 
Object Assembly 
Coding (WISC) or 
Digit Symbol (WAIS) 
N* 64 


Ww te Ww & 
on bo i 
s2s 


10.84 
11.00 
10.37 
10.16 
11.42 


ot to ty te 


® Digit Span omitted 
> Ns are as given, except in Preschool (Similarities and Object Assembly N 
Coding N = 53) and in Elementary School (Coding N = 63). 
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and Jewish children who were attending par- 
On hial S( hools T he verbal scores were higher 
than the performance scores in accordance 
with the cultural pressures exerted for ver 
bal accomplishment by the various subcul 
tures and their schools. As the writer noted 


in another connection (Levinson, 1958b), 


there is reason why a person 
with a superior intelligence should have a 
than performance ability, 


that both verbal and 


priori 


no a 


higher verbal 
providing ol course, 
valid 


performance items are equally 


The 
subculture from which the individual comes 


phasis on verbal skills and the 


of intelligence importance of the 


its en 


, 
with 


act omplishm«e nt 


he gen plication that we 


is that the greater mium pla 


the pre 


by a certain subculture on language 


abstract thinking, the greater will be the 
disparity between verbal and performance 
abilities 

This raises certain questions with respect 
to the Wech tests, 
other tests. Is it possible, for example, that 
the subtests, which are considered 
me (Wechsler, 1944) of 


sler and presumably 


good 


sures important 


functions in the general population, do not 
lidity 


when applied to 


Jewish traditional 


same Vv 
Ss from a highly verbal 


culture 


SUMMARY 


study was made 


A com 


periormanct 


irative 


and verbal abilities 

school children, elementary schooi 
and college students of traditional Jewish 
background. The 
full scale [Qs on either WISC or WAIS. The 


difference between the verbal and periorm 


were matched for 


groups 


ance IQs for the pres hool children was at 
10 level of confidence. However, on the 
and college levels, differences 


statistically 


the 
element iry 
signif 


were found which were 


cant at the .001 level. This is interpreted as 


LEVINSON 


beitf® dere to the cumulative effect of Jew 


ish cultural values emphasizing verbal 


abilities. 
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